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1, INTRODUCTION 

The handwritten signature is very important for every individual as it is widely used for 
authentication purposes in every day life. Each of the signers has their own signature, which is although 
unique but it could vary from time to time, or due to different tools used, such as pen with different pen size, 
stylus, or finger. The handwritten signature authentication system aims to minimize the intrapersonal 
differences [1]-[2]. Signature verification can be classified into two parts which is online and offline. 
This paper focuses on the offline system which could be considered as more challenging compare to the 
online system. This is due to the offline system did not capture the dynamic which can help the classifier to 
authenticate better the signatory [3]. 

Many researches have been conducted to develop handwritten signature authentication system. 
Typical handwritten signature authentication system is shown in Figure 1. In [4], an orientation of the 
skeleton and gravity center point were combined to extract more accurate features. Another feature, 1.e. Euler 
number, was calculated as the subtraction of total number of objects in the handwritten image with total 
number of holes [5]. Other features has been as well in the literature, such as roundness, skewness, kurtosis, 
mean, standard deviation, area, distribution density, entropy, connected component and perimeter [2], [5]. 
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Figure 1. Typical handwritten signature authentication system 


On the classifier part, two methods have been mostly utilized, i.e. SVM [6], neural network [2], 
[7]-[8], as well as deep neural network [1]. Although many researches have been conducted on offline 
handwritten signature authentication, but there are still many aspects have not been considered. In this paper, 
we have collected our own handwritten signature image database with variation in the position and pen size 
and color used to sign. Furthermore, our previous research showed that the use of high pass filter produce 
better accuracy compared to low pass filter [9]. The high pass filter used in [9] is only Canny edge detector. 
Therefore, in this paper, around six edge detection algorithms were used, including Sobel, Prewitt, Roberts, 
Laplacian of Gaussian, Zero Cross, and Canny. 

Deep neural networks uses at least two hidden layers or more in their configuration [10]. 
The optimal structure of the neural networks is still an active research area. In [11], pruning method were 
used to obtain optimum DNN structure. However, the steps involved is rather complex. Therefore, 
the objective of this paper is to develop an offline handwritten signature using edge features and exponential 
decaying number of nodes in the hidden layers of DNN structure. The proposed algorithms will be evaluated 
in terms of training time and recognition rate. 


2. PROPOSED HANDWRITTE SIGNATURES USING DEEP FEEDFORWARD NEURAL 
NETWORKS 
Figure 2 shows our proposed algorithm, in which the system has two main parts, i.e. feature 
extraction and classifier. The feature extraction part is including the image segmentation, aligning and 
cropping, color to grayscale conversion, and image filtering. The classifier part is including the training and 
testing of neural network with the developed image database. 
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Figure 2. Proposed handwritten signature authentication system using deep neural networks 


2.1. Handwritte Signature Image Database And Edge Features 

The handwritten signatures are collected from five persons using five different pen size and styles, 
each for 10 ten times producing a total of 50 signatures have been taken for each person. The total 
handwritten signatures collected are 250 images [9]. The handwritten signatures are then scanned using a 
scanner to convert it to the digital images. The color image is converted to grayscale image to reduce the 
computation. The image size is fixed to be 206 by 128 pixels, which is then changed into column vector of 
26368. Finally, the handwritten signatures database will be divided randomly for each person to be 50% for 
training, 10% for cross validation, and 40% for testing. Figure 3 shows the example of the collected 
signature images. 
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Figure 3. Example of PersonA signatures with five different pen size and color 


Our previous research showed that high pass filter produce better accuracy compared to low pass 
filter [9]. Although canny edge detection is the most popular method for edge detection [12], but we will 
evaluate its effectiveness in DNN configuration against five other algorithms. Figure 4 shows the example of 
edge detection algorithms for Image02 and ImageO5 of Person A. The different pen size and styles will 
produce different edge features, in which the similarity is rather low. In that case, the training of neural 
network will be rather difficult to achieve high recognition rate. Moreover, Table 1 shows the processing 
time of various edge detection algorithms to obtain edge features for all 250 images. It can be found that 
Prewitt operator is the fastest, while Canny edge detection is the slowest. 





(a) (b) (c) (d) (e) (f) 


Figure 4. Example of persona signatures, i.e. image02.jpg (first row) and imageO5.jpg (second row), with 
different edge detection algorithms, (a) sobel, (b) prewitt, (c) roberts, 
(d) laplacian of gaussian, (e) zero cross, (f) canny. 


Table 1. Processing Time of Various Edge Detection Algorithms 


Edge Features Processing Time (seconds) 
Sobel 0.7352 
Prewitt 0.6048 
Roberts 0.7808 
Laplacian of Gaussian 0.8991 
ZeroCross 1.0468 
Canny 1.1808 


2.2. Exponential Decaying Number of Nodes in the Hidden Layers 

The main principle of DNN is to utilize lower level features learning to update the learning of higher 
features. There are many available deep architecture, such as neural networks with many hidden layers and/or 
many hidden variables, convolutional neural networks, recurrent neural networks, and deep belief network 
[10], [13]. In this research, we used deep learning using feedforward neural network architectures with 
hidden layers with many hidden variables [14]. Figure 5 illustrates the deep feedforward neural 
network structure. 
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Figure 5. Deep feedforward neural network structure 


In this paper, we propose an exponential decaying number of hidden nodes due to its simplicity 
compared to pruning method as described in [11]. It can be formulated as follows: 


y = ae (1) 


Where x is neural network layers, while y is the number of nodes. Input layer is defined as x = 0, 
while the last layer will be the output layer. For example, if we have 3 hidden layers (NHidden = 3), x = 0 
is the input layer, x = 1 1s the first hidden layer, x = 2 is the second hidden layer, x = 3 1s the third hidden 
layer, and x = 4 is the output layer. Using curve fitting, we could find the parameter a and b. In our case, at 
x = 0 parameter a = 26368 (input layer) and at x = 4 — y = 5 (output layer). Then, parameter b could be 
calculated as follows: 


1 OutputLayer 
b = -———log (ones) (2) 
NHidden InputLayer 


Where NHidden is the number of hidden layers, InputLayer is the input nodes, and OutputLayer 
is the output nodes. Table 2 shows the example of exponential decaying number of nodes in various hidden 
layers, when the InputLayer = 26368 and OutputLayer = 5, using Eq. (1) and (2). Figure 6 illustrates the 
exponential decaying number of nodes for 4 hidden layers. 


Table 2. Exponential Decaying Number of Nodes in Various Hidden Layers Structures 


NHidden Hidden Layer Nodes Configuration 
1 [363] 
2 [1515 87] 
3 [3094 363 43] 
4 [4750 856 154 28] 
5 [6320 1515 363 87 21] 
6 [7751 2278 670 197 58 17] 
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Figure 6. Example of exponential decaying number of nodes for NHidden = 4 


On the Use of Edge Features and Exponential Decaying Number of Nodes in the... (Teddy Surya Gunawan) 


726 Oj ISSN: 2502-4752 


3. RESULTS AND ANALYSIS 

In this section, the experimental setup, handwritten signature image database and its edge features, 
training and testing of deep feedforward neural network with exponential decaying number of nodes in the 
hidden layers will be discussed. 


3.1. Experimental Setup 

A high performance system was used for processing, i.e. a multicore system with Intel Core 17 6700 
K 4.00 GHz (4 cores with 8 threads), 32 GBytes RAM, 256 GBytes SSD and 2 TBytes hard disk, installed 
with Windows 10 operating system and Matlab 2018a with Image Processing, Signal Processing and Neural 
Network Toolboxes. The handwritten signature database were collected from five person, hence the output 
layer is set to five. The number of nodes in the hidden layer as well as hidden layer will be varied, while the 
patternet() Matlab function will be used. Other types of feedforward neural network can be used as well, 
as described in [14]. 


3.2. Training Phase of Various DFNN Structures 

In Table 3, the best recognition rates were highlighted in bold. Across the row, the maximum 
recognition rate is achieved when the structure of hidden layers are [1000 100 10] and [3094 363 43] with 
recognition rate of 96.89% and 96.67%, respectively. While across the column, the maximum recognition 
rate is achieved for Robert and Canny edge detection algorithms with recognition rate of 89.72% and 
88.33%, respectively. Therefore, these two edge features and two DFNN structures will be further trained 
and tested with the new images. Moreover, the last six rows of Table 3 shows the performance of the 
exponential decaying number of nodes for hidden layer of one to six. Compared to the other DFNN 
structures, it consistently shows high average recognition rate across various edge features. 


Table 3. Recognition Rate (%) of Various DENN Structures 


NHidden Sobel Prewitt Roberts LoG ZeTOCrOss Canny Average 
[10] 96.00 96.67 96.67 86.67 96.00 95.33 94.56 
[20] 74.00 93.33 97.33 91.33 92.67 98.67 91,22 
[30] 96.00 98.00 97.33 94.00 96.67 94.00 96.00 
[40] 96.67 97.33 94.00 96.00 94.67 96.00 95.78 
[50] 96.67 94.67 96.00 96.00 96.00 95.33 95.78 
[100] 96.00 96.67 94.67 91.33 93.33 95.33 94.56 
[200] 97.33 86.00 84.00 95.33 75.33 96.67 89.11 
[300] 94.00 86.67 95.33 86.67 95.33 96.00 92.33 
[400] 96.00 95.33 93.33 95.33 94.67 76.67 91.89 
[500] 94.67 84.67 95.33 94.00 95.33 94.00 93.00 
[1000] 93.33 94.00 94.00 82.00 92.67 20.00 79.33 
[2000] 95.33 92.67 69.33 93.33 93.33 95.33 89.89 
[3000] 94.67 60.00 90.67 88.00 88.67 93.33 85.89 
[4000] 90.00 23,33 91.33 74.67 92.67 81.33 75.56 
[5000] S135 93.33 77.33 89.33 92.67 70.67 80.11 
[10000] 58.67 20.00 56.67 72.67 69.33 42.00 53.22 
[10 10] 73.33 72.00 78.67 71.33 20.00 84.67 66.67 
[20 20] 92.67 23,39 91.33 94.00 92.00 98.00 81.89 
[30 30] 81.33 95.33 95,33 22.67 94.67 96.67 81.00 
[40 40] 96.67 94.00 64.67 95.33 94.67 96.00 90.22 
[50 50] 97.33 95.33 95.33 56.67 50.67 94.67 81.67 
[100 100] 30.67 96.67 92.67 92.00 43.33 95.33 75.11 
[100 10] 91.33 95.33 90.67 96.00 92.00 78.67 90.67 
[10 10 10] 66.67 20.00 78.00 84.00 67.33 50.67 61.11 
[20 20 20] 80.67 92.00 74.67 95.33 94.00 80.67 86.22 
[30 30 30] 96.00 96.67 77.33 87.33 34.67 96.00 81.33 
[40 40 40] 95.33 94.67 94.00 96.00 69.33 96.00 90.89 
[50 50 50] 96.00 95.33 96.67 94.00 94.67 97.33 95.67 
[100 100 100] 94.67 96.00 98.00 95.33 54.00 95.33 88.89 
[1000 100 10] 96.67 96.00 98.67 96.67 96.00 97:33 96.89 
[363] 94.67 94.67 94.00 94.67 94.00 96.00 94.67 
[1515 87] 84.67 90.67 95.33 94.67 96.67 98.00 93.34 
[3094 363 43] 96.67 98.00 98.00 95.33 95.33 96.67 96.67 
[4750 856 154 28] 94.00 96.00 98.00 95.33 95.33 96.67 95.89 
[6320 1515 363 87 21] 95.33 95.33 98.00 96.00 97.33 96.67 96.44 
[7751 2278 670 197 58 17] 70.00 96.67 97.33 96.67 96.00 98 92.45 
Average 87.54 84.63 89.72 88.22 84.20 88.33 87.11 
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In the training phase, 50% of the image database was used for training, and 10% was used for cross 
validation. The activaton function used on each nodes in the hidden layers is sigmoid function, except for the 
output layer which is softmax layer. The scaled conjugate gradient was used as the training function of 
backpropagation algorithm. The DFNN were trained for 50 epochs. For each row in Table 3, the number of 
nodes are the same, therefore the training time is relatively similar. 


3.3. Optimization and Testing Phase of Various DENN Structures 

For testing purpose, we set the number of epochs to 1000. Table 4 shows the results of the training 
and testing of the optimum DFNN structures for two edge features, i.e. Roberts and Canny algorithms. 
On average, the proposed exponential decaying number of nodes DFNWN strucutures performed better in 
terms of testing recognition rate across two edge features, 1.e. 69% compared to 66%. Based on this result, 
another experiments using exponential decaying DFNN structures was conducted using Canny edge features 
only and the results is presented in Table 5. For better generalization and to avoid over-fitting, the training 
epoch was set to 200 as the maximum performance in cross validation is achieved at much lower epoch then 
1000. 


Table 4. Training and Testing of Optimum DFNN Structures 


NHidden Edge Training Training Recognition Rate Testing Recognition Rate 
Features Time (s) (%) (%) 
[1000 100 10] Roberts 1718 95.33 65.00 
[1000 100 10] Canny 2295 97.33 67.00 
[3094 363 43] Roberts 5144 98.00 68.00 
[3094 363 43] Canny 6303 98.67 70.00 


Table 5. Testing Recognition Rate of Exponential Decaying DFNN Structures 


Training Time Training Recognition Rate Testing Recognition Rate 


NHidden (s) (%) (%) 
[363] 170 93.33 51.00 
[1515 87] 690 96.67 69.00 
[3094 363 43] 1418 96.67 72.00 
[4750 856 154 28] 2238 100.00 73.00 
[6320 1515 363 87 21] 3108 99.33 75.00 
[7751 2278 670 197 58 17] 3966 96.00 64.00 


From Table 5, although the performance of a trained DENN is non deterministic, it could be 
concluded that there is a positive trends in the recognition rate when the number of hidden layers of DFNN 
were increased from | to 5. While increasing futher the number of layer did not improve the recognition rate. 
This could be cause by overfitting or less of training data to better use of the deeper layers. Interestingly, 
the training recognition rate of 100 percent did not translate into higher testing recognition rate. In summary, 
the proposed exponential decaying number of nodes in the hidden layers provide a better DFNN structure 
with high recognition rate. The proposed system could be evaluated with other handwritten image database to 
evaluate further its effectiveness. 


4. CONCLUSION 

This paper has presented offline handwritten signature authentication system using edge features 
and DENN. We formulated exponential decaying number of nodes in the hidden layers of DFNN structures 
and used it on DFNN. Moreover, six edge detection algorithms were evaluated, in which it was found that 
Roberts and Canny edge operators producing higher performance. Handwritten image database has been 
recorded which consists of 10 trial with 5 different pen of 5 person producing total of 250 images.Results 
showed that our proposed method, 1.e. exponential decaying number of nodes in the hidden layers, produce 
higher accuracy. The highest testing recognition rate was 75.0% using five hidden layers. Further research 
includes the use of different handwritten image database, or the use of other types of deep learning like 
convolutional neural networks. 
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